Emotion recognition plays an important role in intelligent human–computer interaction, but the related research still faces the problems of low accuracy and subject dependence. In this paper, an open-source software toolbox called MindLink-Eumpy is developed to recognize emotions by integrating electroencephalogram and facial expression information. MindLink-Eumpy first applies a series of tools to automatically obtain physiological data from subjects and then analyzes the obtained facial expression data and EEG data, respectively, and finally fuses the two different signals at a decision (...) level. In the detection of facial expressions, the algorithm used by MindLink-Eumpy is a multitask convolutional neural network based on transfer learning technique. In the detection of EEG, MindLink-Eumpy provides two algorithms, including a subject-dependent model based on support vector machine and a subject-independent model based on long short-term memory network. In the decision-level fusion, weight enumerator and AdaBoost technique are applied to combine the predictions of SVM and CNN. We conducted two offline experiments on the Database for Emotion Analysis Using Physiological Signals dataset and the Multimodal Database for Affect Recognition and Implicit Tagging dataset, respectively, and conducted an online experiment on 15 healthy subjects. The results show that multimodal methods outperform single-modal methods in both offline and online experiments. In the subject-dependent condition, the multimodal method achieved an accuracy of 71.00% in the valence dimension and an accuracy of 72.14% in the arousal dimension. In the subject-independent condition, the LSTM-based method achieved an accuracy of 78.56% in the valence dimension and an accuracy of 77.22% in the arousal dimension. The feasibility and efficiency of MindLink-Eumpy for emotion recognition is thus demonstrated. (shrink)

The growth of strawberry will be stressed by biological or abiotic factors, which will cause a great threat to the yield and quality of strawberry, in which various strawberry diseased. However, the traditional identification methods have high misjudgment rate and poor real-time performance. In today's era of increasing demand for strawberry yield and quality, it is obvious that the traditional strawberry disease identification methods mainly rely on personal experience and naked eye observation and cannot meet the needs of people for (...) strawberry disease identification and control. Therefore, it is necessary to find a more effective method to identify strawberry diseases efficiently and provide corresponding disease description and control methods. In this paper, based on the deep convolution neural network technology, the recognition of strawberry common diseases was studied, as well as a new method based on deep convolution neural network strawberry disease recognition algorithm, through the normal training of strawberry image feature representation in different scenes, and then through the application of transfer learning method, the strawberry disease image features are added to the training set, and finally the features are classified and recognized to achieve the goal of disease recognition. Moreover, attention mechanism and central damage function are introduced into the classical convolutional neural network to solve the problem that the information loss of key feature areas in the existing classification methods of convolutional neural network affects the classification effect, and further improves the accuracy of convolutional neural network in image classification. (shrink)